Target recognition and localization methods using a laser sensor for wheeled mobile robots

ABSTRACT

A target system that includes a target that is selected, wherein the target includes a surface with depth variations. The target system additionally includes a laser sensor adapted to scan the target for localization.

This application is a divisional of U.S. application Ser. No. 15/621,091filed on Jun. 13, 2017, which is a divisional of U.S. application Ser.No. 14/123,062 filed on Aug. 29, 2014, which itself is a 35 USC § 371national stage entry of International Application No. PCT/US2012/040499filed on Jun. 1, 2012, which claims priority to U.S. ProvisionalApplication Ser. No. 61/492,669 filed on Jun. 2, 2011 and U.S.Provisional Application Ser. No. 61/552,823 filed on Oct. 28, 2011; allof the foregoing are expressly incorporated herein by reference.

BACKGROUND

Localization of indoor wheeled mobile robots (IWMR) has been an activearea of research since the 1980s. Self-localization is defined as thecapability to determine its own posture (orientation and location).Dead-reckoning navigation techniques, which rely on internal sensorssuch as the odometer or encoders, have been the earliest of techniquesused in this field. In dead-reckoning systems, the posture error growswithout bound, which limited its use as a secondary technique with otherlocalization methods. Different types of external sensors orcombinations of external sensors have also been used for localization.The sensors employed include video cameras, infrared sensors, lasersensors, ultrasonic sensors, radio frequency identification sensors(RFID), sonar sensors and global positioning system (GPS), etc.Different sensor-based localization methods have their own applicationlimitations. Camera-based localization depends heavily on the lightingcondition of the ambient environment, thus rendering it ineffectiveunder insufficient lighting conditions. RFID sensor needs to know theambient environment, henceforth reducing its effectiveness in situationswhere knowledge about the environment is unavailable.

Ultrasonic sensors are more sensitive to environmental noises. Forexample, in a noisy environment the diffusion of ultrasonic waves couldbe high which reduces the accuracy. Thus ultrasonic sensors cannot beused as a stand-alone sensor for localization in a noisy environment andcan only be used along with other sensors. GPS-based localization hasrelatively low accuracy, slow update rate, and availability issues.Laser sensor based localization supersedes these sensors in that itdoesn't depend on lighting nor is it sensitive to environmental noise.Also, unlike GPS based localization, laser-based IWMR localization doesnot need a local base station, which makes GPS-based localization anexpensive technique for indoor applications.

Laser sensor based IWMR localization generally needs a priori knowledgeof the entire environment or at least the landmark features in theenvironment. Thus existing laser sensor based localization algorithmscan be divided into two categories—algorithms that search for patternsin the entire environment and algorithms that seek landmark features onthe floor such as lines, line segments, and so on.

Localization results have also been used to update local portions of aglobal map. The process of updating a global map using the localizationresults is termed as Simultaneous Localization and Mapping (SLAM).Different algorithms have been proposed to perform SLAM. There have beenefforts to reduce the complexity of these algorithms. If the dependenceon sensor fusion techniques to obtain accurate localization results isreduced, complexity of the SLAM algorithms can also be lowered. In thepast, SLAM problems have been conducted in static and dynamicenvironments.

BRIEF DESCRIPTION

In accordance with one aspect a target system that includes a targetthat is selected, wherein the target includes a surface with depthvariations. The target system also includes a laser sensor adapted toscan the target for localization.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustration of laser sensor based IWMR localization.

FIG. 2 is a cross-section of an example target.

FIG. 3 is an Illustration of measured distance when the laser sensorscans through the target surface.

FIG. 4 is a cross-section of a target and the design parameters.

FIG. 5 is an illustration of worst angle of a laser sensor.

FIG. 6 is an Illustration of a target design.

FIG. 7 is an experimental setup for determining the worst angle of alaser sensor.

FIG. 8 is a cross-section of a laser sensor specific target shape(asymmetrical).

FIG. 9 is a cross-section of a laser sensor specific target shape(symmetrical).

FIG. 10 is a pseudo code for the target recognition algorithm.

FIG. 11 graphically depicts experimental data collection during a targetscan.

FIG. 12 graphically depicts edge detection from experimental data.

FIG. 13 graphically depicts IWMR orientation determination.

FIG. 14 is an illustration of three different zones in front of atarget.

FIG. 15 graphically depicts three different templates for a specifictarget.

FIG. 16 graphically depicts laser sensor measurement and rotary actuatorangular position versus time.

FIG. 17 graphically depicts IWMR orientation determined by thealgorithm.

FIG. 18 graphically depicts target shape in laser sensor co-ordinates.

FIG. 19 graphically depicts center template match.

FIG. 20 graphically depicts laser sensor measurement and rotary actuatorangle versus time.

FIG. 21 graphically depicts vehicle orientation when IWMR is in Zone I.

FIG. 22 graphically depicts left template match.

FIG. 23 graphically depicts laser sensor measurement and rotary angleversus time.

FIG. 24 graphically depicts vehicle orientation determined by thealgorithm.

FIG. 25 graphically depicts right template match.

FIG. 26 graphically depicts center template match.

FIG. 27 graphically depicts left template match.

FIG. 28 graphically depicts right template match.

FIG. 29 is an Illustration of notations used in localization.

FIG. 30 graphically depicts localization experimental results (IWMR inQuadrant III).

FIG. 31 graphically depicts localization experimental results (IWMR inQuadrant IV).

FIG. 32 graphically depicts localization results (orientation of IWMR=90degrees).

FIG. 33 graphically depicts localization results (orientation of IWMR=45degrees).

FIG. 34 graphically depicts localization results (IWMR in quadrant IV).

FIG. 35 graphically depicts localization results (IWMR in quadrant III).

FIG. 36 graphically depicts localization results (orientation of IWMR=90degrees).

FIG. 37 graphically depicts localization results (orientation of IWMR=45degrees).

FIG. 38 graphically depicts localization results (error in orientation).

FIG. 39 graphically depicts localization results (error in orientation,when length of target <2*noise).

FIG. 40 graphically depicts error in orientation vs. noise inmeasurement.

FIG. 41 graphically depicts error in orientation vs. resolution error.

DETAILED DESCRIPTION

The subject disclosure proposes a new technique for localizing IWMRs (inan unknown static 2-D environment that is, no knowledge about theenvironment or landmark features in the environment is needed) based onlaser sensor distance measurements alone (with respect to a target). Theproposed technique is different from the existing ones in that it doesnot need a priori knowledge about the environment and thus gives theflexibility of employing this technique in uncertain environments. Theonly requirement for this technique is the capability to place thetarget at a known global location in an uncertain environment (noknowledge about the environment is required). Further, the complexity ofSLAM algorithms can be reduced by developing a localization techniquethat uses a laser sensor alone, with the assumption that the unknownenvironment is static (i.e., there is no moving object in the entireenvironment).

The system hardware configuration for the proposed localization schemeaccording to one embodiment is shown in FIG. 1. FIG. 1 depicts anexemplary IWMR having a laser sensor operably connected thereto. Thelaser sensor can be mounted on a rotary actuator that can span a wideangular section (e.g., 180 degrees) for reliably detecting the targetand self-localizing in a wide range. To further increase the operatingrange of the exemplary system, a linear actuator, fixed on the IWMRbody, can be used as a guide way to move the rotary actuator and lasersensor together along the IWMR lateral direction.

According to one aspect, the target used in this localization method hasa surface with uniquely combined depth variations. As a result, thetarget can be identified properly by the distance measurements when thelaser sensor beam scans through the target surface. The cross-section ofan example target that can be used is given in FIG. 2. The center ofthis target (small dot) marks the origin location from which the globalco-ordinates are measured.

FIG. 3 illustrates the edge detected in the laser sensor measurement asthe target surface is scanned by the laser beam once when the IWMR islocated in the third quadrant. This distance measurement pattern matchesexactly with the physical target depth pattern shown in FIG. 2. Byexamining the measured distance sequence pattern, the target can thus berecognized. Note that more complex target shapes can be used to elevatethe target uniqueness and make it more distinguishable from itssurroundings and backgrounds. The detected target, whose global locationand orientation (always parallel to the global x axis) are known,together with the laser sensor distance measurements with respect to thetarget can be employed to self-localize the IWMR in the globalcoordinates.

Target Design

As will be appreciated by those skilled in the art, the target design,which includes the target shape, material, and color, will affect thelaser sensor distance measurement accuracy, visible range andconsequently influence the target recognition capability andlocalization accuracy of the system. Several target design guidelinesgenerated from experimental results are described below.

Generalized Target Design Methodology and Guidelines

FIG. 4 shows the cross section of an exemplary target and correspondingdesign parameters, namely the depth and width pairs (d_(i), w₁). The x-yaxis on the target marks the global co-ordinates along which the IWMR islocalized. The target may be unique in shape and to detect the edgesrobustly there may be at least two genuine edge depth variations asshown in FIG. 4. (in this case i=2). The design effort is focused inchoosing the ratio between edge depth-to-width. This can be chosen basedon the worst angle of the laser sensor, which is defined as the anglewhere

-   -   1) The laser sensor loses its required accuracy, due to        refraction of signal;    -   2) The entire length of the target cannot be seen by the laser        sensor; and    -   3) Neither of the two edges of a slot can be detected by the        laser sensor measurements.        Thus, worst angle of a laser sensor is the sector in which a        laser sensor cannot operate accurately. This is depicted in FIG.        5.

An exemplary design is one that takes into consideration the worstscenario. The design (edge depth-to-width ratio) should address theevent when the laser sensor is placed at the worst angle. It should besuch that even if the laser sensor is viewing the target from the worstangle, all d_(i)'s in the d_(i) and w_(i) pairs are seen. Thus the angleformed by all of these d_(i) and w_(i) pairs should always be greaterthan the worst angle. This will reduce the chance of detecting two edgeswhich is necessary for the target recognition technique. Thus, theedge-to-depth ratio should be greater than or equal to the tangent ofthe worst angle.

$\begin{matrix}{{{\tan^{- 1}\left( \frac{d_{i}}{w_{i}} \right)} \geq {worst\_ angle}},{{for}\mspace{14mu} {all}\mspace{14mu} {i.({or})}}} & (1) \\{{\frac{d_{i}}{w_{i}} \geq {\tan ({worst\_ angle})}},{{for}\mspace{14mu} {all}\mspace{14mu} {i.}}} & (2)\end{matrix}$

If the condition given in Eq. (1) is not met by any d_(i) and w_(i)pair, then the chance of detecting two edges is reduced. Thus, theedge-to-depth ratio should be greater than or equal to the tangent ofthe worst angle. An example scenario is illustrated in FIG. 6. If thedesigned target does not meet the condition given in Eq. (1), in the d₁and w₁ pair alone, then the edge d₁ will not be seen in the laser sensormeasurement. In FIG. 6, the solid dot represents the laser sensor(located on the worst angle); the dashed line and dashed-dot line denotetwo successive scanning instances of the laser sensor. As shown, thesurface on width w₁ (blocked in FIG. 6) cannot be seen by the lasersensor. Hence the depth d₁ will not be seen in the laser sensormeasurements. Thus a failure to meet condition given in Eq. (1) can leadto a target that has a chance of not being recognized by the targetrecognition algorithm.

Laser Sensor Specific Target Design

It is evident from the definition of worst angle that it depends on thespecific laser sensor being used. The value of worst angle has to bedetermined for the specific laser sensor. Experiments were conducted foran example laser sensor used in one embodiment of this disclosure (ODSL96B M/V6-2000-S12 manufactured by Leuze Electronics), to determine theworst angle. The laser sensor measurements can be collected in a dSPACEMicro Auto Box (MABX) as shown in FIG. 7. Here, the laser sensor isplaced at different angles closer to the target at a known location forevaluating the accuracy of measurement. The worst angle for thisspecific laser sensor was determined to be 14°. Once a particular worstangle value is known or determined, targets (specific for one exemplarylaser sensor) can be designed.

The edge depth-to-width ratio according to the formula given in Eq. (2)should be greater than 1/4.0108. Taking this into consideration, atarget can be designed with an edge depth-to-width ratio of 1/4. Anexemplary designed target is shown in FIG. 8. The target shown in FIG. 8is asymmetric about its origin; hence another target that is symmetricabout the origin is also designed. FIG. 9 gives an idea about the designparameters of the symmetrical target.

Overall Length of the Target

The overall length of the target can be chosen based on scanning timebeing proportional to the overall length of the target. Thus, the targetshould not be too long. However, the target should be long enough toaccommodate at least two edges that obey the condition shown in Eq. (2).The length portions other than w_(i)'s do not carry any significance,they are merely present to separate the two edges.

Material Choice for the Target

Another aspect of target design is material selection. Differentmaterials and colors can be tested for reflectivity property to a lasersource. In one embodiment, the materials chosen were polished aluminum,unpolished stainless steel, and the colors chosen were white, red andorange. Polished aluminum and unpolished stainless steel were chosen fortheir high reflectivity and ease of machinability. The colors chosen arethe most popular ones used in roadside warnings due to their highreflectivity. In order to select the appropriate material for thetarget, experiments were conducted to see the influence of reflectivityon the accuracy of laser sensor measurements. Table 1 shows the lasersensor measurements when the sensor was placed at a distance of 930 mmperpendicular to target coated with all of these materials.

TABLE 1 Laser sensor measurement errors (when laser sensor isperpendicular to the target) Laser sensor Material/color measurementsError used (in mm) (in %) White color 932.2393 0.24 Red color 937.78020.84 Orange color 936.9589 0.75 Aluminum 931.2392 0.13 (polished)Stainless 933.9255 0.42 steel (Unpolished)

TABLE 2 Laser sensor measurement errors (when laser sensor is at theworst angle) Laser sensor Material/color measurements Error (in used (inmm) %) White color 933.3101 0.36 Red color 936.874 0.74 Orange color936.276 0.67 Aluminum 0 100 (polished) Stainless 943.2503 1.42 steel(Unpolished)

Table 2 above shows the laser sensor measurements when the sensor wasplaced at a distance of 930 mm and scanning the farthest point on thetarget at the worst angle (14°). In Table 2 it is evident that thepolished aluminum reflector behaves like a mirror and hence will not bea good choice for the target material. Using the above experimentaldata, white color coating can be chosen for the target.

Target Recognition Method

This section will explain the target recognition method used accordingto one embodiment. Pattern recognition in wheeled mobile robots is usedin vision-based localization techniques. The pattern recognitiontechniques include different measures like Image Euclidean distance andHausdorff distance. Hausdorff distance is a measure that is widely usedin pattern recognition, because of its robustness to noise. In thismeasure is used to compare pattern set ‘A’ with the image set ‘B’obtained from the camera feed on the wheeled mobile robot. An exactmatch is shown when the Hausdorff distance between the two sets is zero.The definition for Hausdorff distance is described in Eq. (3). Given twopoint sets A and B, the Hausdorff distance between A and B is defined as

$\begin{matrix}{{{H\left( {A,B} \right)} = {\max \left( {{h\left( {A,B} \right)},{h\left( {B,A} \right)}} \right)}}{where}} & (3) \\{{h\left( {A,B} \right)} = {\sup\limits_{a \in A}\inf\limits_{b \in B}{{a - b}}}} & (4)\end{matrix}$

and ∥.∥ represents Euclidean norm. The function h (A, B) is called thedirected Hausdorff distance from A to B.

Target Recognition Algorithm

As mentioned above, a linear actuator and rotary actuator can providethe laser sensor with linear and rotary motion capabilities. Of these,the rotary actuation is adapted to scan the frontal area of an IWMR andthe linear actuation is adapted to increase the robustness (e.g., incase of an obstacle in front of the target). Here, the assumption isthat 1) the linear actuator position is on the left end of the guide wayor 2) at least the position at which the linear actuator is located whenthe laser sensor measurements are taken is known. An exemplary pseudocode for the target recognition method/algorithm is shown in FIG. 10.

In FIG. 11, X_(v)−Y_(v) shows the IWMR body-fixed co-ordinates. The datacollected are 1) laser sensor measurements cm′ and 2) rotary actuatorsposition ‘θ’ with respect to the positive x_(v) axis (which isassociated with the laser sensor guide way). The pseudo code explainsclearly that the algorithm looks for two edges that have a minimumlength equal to the minimum depth of the target (e.g., 25 mm). FIG. 12shows the scenario in which |Δm_(i)|> smallest depth of the targetcondition is met and the edge detected is shown.

$\begin{matrix}{\begin{bmatrix}X_{v} \\Y_{v}\end{bmatrix} = \begin{bmatrix}{m\; \cos \; \theta} \\{m\; \sin \; \theta}\end{bmatrix}} & (5)\end{matrix}$

Target Recognition Algorithm

Eq. (5) can be used to transform the entire set of data collected intoIWMR co-ordinates (seen from the laser sensor). When two such edges aredetected in the measurements, corresponding time instant points in theIWMR body-fixed co-ordinate information (x_(v) and Y_(v)) can be joinedby a straight line. The algorithm makes sure that the corresponding timeinstant points are from the front surface of the target.

The IWMR orientation determination section of the pseudo code isexplained with reference to FIG. 13. The fact that the target is placedwith its surface along the global x axis can be used in orientationdetermination. The slope of this line with respect to x_(v) axis isequal to the negative of the orientation Φ of IWMR in the globalco-ordinates.

$\begin{matrix}{\begin{bmatrix}X_{l} \\Y_{l}\end{bmatrix} = {\begin{bmatrix}{\cos \; \Phi} & {{- \sin}\; \Phi} \\{\sin \; \Phi} & {\cos \; \Phi}\end{bmatrix}\begin{bmatrix}X_{v} \\Y_{v}\end{bmatrix}}} & (6)\end{matrix}$

Eq. (6) can be used to transform the edge points into the laser sensorco-ordinates x_(l)-Y_(l) (seen from the laser sensor). This x_(l)-Y_(l)co-ordinate set is the additive inverse of the global co-ordinates x-y.This has been introduced so that the templates of the target can betranslated to these co-ordinates and compared; to see if the target isrecognized (will be explained in detail below).

Target Template Generation

Three different templates need to be created for every target based onthe location of the IWMR. The three zones in front of the target wherethe IWMR could be located for which three different templates are neededare shown in FIG. 14. In FIG. 14, the edges are marked with numbers from1 through 6 for easier reference. If the IWMR is located in Zone I,edges 1, 3 and 5 will be seen by the laser sensor. If the IWMR islocated in Zone II, all 6 edges will be seen in the laser sensormeasurements. Similarly, if the IWMR is located in Zone III, the lasersensor measurement will contain the edges 2, 4 and 6.

Hence while choosing the template; this information can be included asshown in FIG. 15. In order to have a generic template it is defined inglobal co-ordinates. The generic template can be translated to the laserco-ordinates, which is explained below. The Hausdorff distance betweenthe templates and the transformed target information is supposed to bezero (when they are exactly matched). Here, since the laser sensormeasurements are noisy, a small value instead of zero is used as thethreshold of the Hausdorff distance. Such a threshold value can beexperimentally determined.

Target Recognition Experimental Validation

This section shows the experimental results of target recognition forboth the targets designed according to one embodiment. As explainedabove, the rotary actuator motion is a priority in target recognition.The rotary actuator rotates at a constant speed which can be chosenbased on a few criteria:

-   -   At this sampling rate the laser sensor measurements are Gaussian        with a standard deviation of about 3 mm.    -   The laser sensor used should have a small amount of latency        (0.01 sec, value supplied by the manufacturer) for its        measurements to be accurate. Thus, the measurement sampling rate        should not be greater than 100 Hz.    -   When the rotary sensor is scanning the entire frontal area        (180°), if the scanning speed is too high, the laser sensor        accuracy will be affected due to the fact mentioned in the        previous point.

Test runs at different speeds were done to choose the ideal speed of therotary actuator. These results are tabulated in Table 3 below. In thesetest runs, the rotary actuator was oriented at 0° with respect to X_(v)axis of the IWMR and at a distance of 675 mm to the target.

TABLE 3 Localization error for different rotary actuator speeds RotaryOrientation Location actuator error (in error scanning deg) (in mm)speed (Orientation - (Center - (rad/s) 0°) 675 mm) 3.1416 8.4982 201.5708 5.2154 2.9 0.7854 1.8826 2.0 0.3927 0.2651 1.8

From Table 3 it is clear that the localization accuracy is affectedsignificantly at high speeds, and when it gets lesser than 0.7854 rad/s,the accuracy does not change much. Thus the 0.7854 rad/s speed can beused to perform target recognition, because it takes less time (comparedto 0.3927 rad/s) to scan the entire front area and has good accuracy.The asymmetric target designed (shown in FIG. 8) was tested for targetrecognition. Laser sensor measurements plotted against time (with morethan two edges identified by the algorithm) is provided in FIG. 16. Italso shows the rotary actuator's position.

Determination of IWMR orientation in the global co-ordinates using theexemplar method explained above is shown in FIG. 17. In this experiment,the IWMR location is given as X=0 mm and Y=−615 mm with orientation=45deg. This is equivalent to saying that the IWMR was in Zone II, which isexplained in FIG. 14. FIG. 18 shows the target shape in laser sensorco-ordinates, which can be obtained by using Eq. (6).

To perform target recognition, the templates have to be translated fromthe global co-ordinates to the laser sensor co-ordinates. For thistranslation, the fact that “points on the front surface of the targetare selected in the edge detection algorithm” can be used. The entiretemplate can be translated such that the points on the template (thosewhich correspond to the points on the front surface of the target) matchthe points from the edge detection algorithm. In other words, thetemplates have to be translated in the global x direction byx_(l)(t_(max(i))) and in the global y direction by the average of Y_(l)values of points identified in the edge detection part.

Here, x_(l)(t_(max(i)))=−252.2514 mm and average of the Y_(l) values ofthe points identified in edge detection=617.2743 mm. FIG. 19 shows themoved template on top of the data points and it can be seen that theminimum Hausdorff distance is obtained when the center template matches.The vehicle orientation determined by the algorithm may not be 100%accurate due to the signal noises. This error in orientation results hasalso affected the minimum value, which can be seen clearly from FIG. 19.

The IWMR was located in Zone I, oriented at 90 degrees and at a distanceof X=−300 mm and Y=−550 mm for the next set of experiments.

FIG. 20 shows the laser sensor measurements plotted against time, withmore than two edges being identified. It also shows the rotaryactuator's angular position plotted versus time.

FIG. 21 shows the vehicle orientation in the global co-ordinatesdetermined by the exemplary method.

FIG. 22 and FIG. 25 show that this algorithm works even when the vehicleis located in Zone I and Zone III, where the algorithm selected the leftand right templates, respectively.

In Zone III, the vehicle was oriented at 0 degrees and at a locationX=300 mm and Y=−600 mm. The laser sensor measurements and rotaryactuator position is plotted against time in FIG. 23. IWMR orientationdetermined by the exemplary method is shown in FIG. 24.

The symmetric target designed (shown in FIG. 9) was tested for targetrecognition at the same experimental locations. The results aretabulated as a comparison chart against target recognition for theasymmetric target in Table 4.

TABLE 4 Target recognition. Target recognition, Location of IWMR (inHausdorff distance (in mm) and orientation mm) (in deg) AsymmetricSymmetric X Y φ Zone target target 0 −615 45 1 36.7957 31.4817 −300 −55090 2 40.9363 32.7109 300 −600 0 3 37.7446 15.1800

FIG. 26-FIG. 28 give a visual representation of the target recognitionalgorithm for the symmetric target when the IWMR is located in Zone II,Zone I and Zone III respectively. From Table 4 it can be seen that theHausdorff distance value for the symmetric target is smaller compared tothat of the asymmetric target. This may be attributed to the fact thatthe symmetric target has more number of edges than the asymmetrictarget.

IWMR Localization Method and Results

The experimental results of the target recognition algorithm show thatthe designed targets can be recognized. Although that in itself is avalidation for the target design, this section presents the experimentalresults that show the localization results for the designed asymmetrictarget.

FIG. 29 shows a schematic design with the notations used in theexemplary IWMR localization method. The angles measured with respect tothe positive x-axis of the IWMR body-fixed (X_(v)) from the left end ofthe laser sensor guide way to the left and right ends of the target aredenoted bye θ_(1L), θ_(1R) respectively. Similarly the angles measuredwith respect to the positive x-axis of the IWMR (X_(v)) from the rightend of the laser sensor guide way to the left and right ends of thetarget are denoted by θ_(2L), θ_(2R) respectively. The laser sensormeasurements from the left end of the laser sensor guide way to the leftand right ends of the target are denoted by m_(1L) and m_(1R),respectively, and the set of measurements from the right end of thelaser sensor guide way to the left and right ends of the target aredenoted by m_(2L) and m_(2R), respectively.

Analytical Determination of Location and Orientation

Here, the fact that a quadrilateral is formed between the two distancemeasurements (m_(1L) and m_(2R)), the laser sensor guide way length (L)and the target object length (l) can be used to find the orientation ofthe vehicle in the global co-ordinates.

The area of quadrilateral using the sides and diagonals given in Eq. (7)(which are known) can be equated to the area of quadrilateral usingsides and the angles included given in Eq. (8) (one of them is unknown).The unknown angle β can be calculated from Eq. (9).

area_sides_diagonals=¼√{square root over (4m _(1R) ² m _(2L) ²−(m _(1L)² +m _(2R) ² −l ² −L ²)²)}  (7)

area_sides_angles=½Lm _(1L) sin(θ_(1L))+½lm _(2R) sin(β)  (8)

¼√{square root over (4m _(1R) ² m _(2L) ²−(m _(1L) ² +m _(2R) ² −l ² −L²)²)}=½Lm _(1L) sin(θ_(1L))+½lm _(2R) sin(β)  (9)

The angle made by the line joining the right end of the laser sensorguide way to the right end of the target with the global positive x axis(x) can be found from the previous step to be equal to the unknownquantity β. The vehicle orientation with respect to the global positivex-axis (x) ‘ϕ’ (shown in FIG. 29), can then be calculated using theformula given in Eq. (10) and Eq. (11).

$\begin{matrix}{\varphi = {\theta_{2R} - \beta}} & (10) \\{\varphi = {\theta_{2R} - {\sin^{- 1}\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{1L}^{2} + m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack}}} & (11)\end{matrix}$

The location of the vehicle (the left end of the scanner guide-way inthis case) with respect to the left end of the target on the vehicleco-ordinate axes can be found out using simple kinematic analysis. Eq.(12) shows the formula for the same.

$\begin{matrix}{\begin{bmatrix}x_{v} \\y_{v}\end{bmatrix} = {\begin{bmatrix}{{- {u_{s}\left( {m_{1R} - m_{1L}} \right)}}\cos \; \theta_{1L}} & {{u_{s}\left( {m_{1L} - m_{1R}} \right)}\cos \; \theta_{1R}} \\{{- {u_{s}\left( {m_{1R} - m_{1L}} \right)}}\sin \; \theta_{1L}} & {{- {u_{s}\left( {m_{1L} - m_{1R}} \right)}}\sin \; \theta_{1R}}\end{bmatrix}\begin{bmatrix}m_{1L} \\m_{1R}\end{bmatrix}}} & (12)\end{matrix}$

Here, a unit step function u_(s)(□) is included, whose value is 1 whenits argument is non-negative and zero otherwise. This unit step functionis included so that based on the laser sensor measurements, the IWMRlocation in quadrant III or quadrant IV can be distinguished. Then theappropriate measurements can be used to determine the IWMR's position.The location on the vehicle co-ordinate axis can then be transformed tothe global co-ordinate axis by using the transformation matrix shown inEq. (13).

$\begin{matrix}{\begin{bmatrix}x \\y\end{bmatrix} = {{\begin{bmatrix}{\cos \; \varphi} & {\sin \; \varphi} \\{{- \sin}\; \varphi} & {\cos \; \varphi}\end{bmatrix}\begin{bmatrix}x_{v} \\y_{v}\end{bmatrix}} + {\quad{\begin{bmatrix}{- {u_{s}\left( {m_{1R} - m_{1L}} \right)}} & {u_{s}\left( {m_{1L} - m_{1R}} \right)} \\0 & 0\end{bmatrix}\begin{bmatrix}l_{1} \\l_{2}\end{bmatrix}}}}} & (13)\end{matrix}$

FIG. 30 and FIG. 31 show the experimental results obtained using thiskinematic based localization technique, when the asymmetrical target istested.

In FIG. 30, the left end of laser sensor guide way is physically placedat x=−600, y=−400 and with an IWMR orientation of 0 degrees. The blacksquare in FIG. 30-FIG. 33 is the localization result using laser sensormeasurements. In order to make the figures self-explanatory, an IWMR isdrawn around the laser sensor guide way.

TABLE 5 Localization results. Actual location (in mm) and Localizationorientation (in Localization results (in deg) results (in mm) deg) x y φx y φ −600 −400 0 −598.72 −400 0 400 −400 0 399.28 −398.78 0 −200 −40090 −200 −398.54 90 −200 −800 45 −199.54 −798.73 45

The experimental location and the localization results for theexperiments carried out in FIG. 30-FIG. 33 is tabulated in Table 5above. FIG. 32 and FIG. 33 show the accuracy of the localization withexperimental results when IWMR orientation is other than 0 degrees.

From these experimental results, it will be appreciated by those skilledin the art that the analytical determination for location andorientation works well, even with noise filled laser sensormeasurements.

Analysis of Design Parameters

Next, optimizing design parameters, e.g., a) length of the target and b)length of the laser sensor guide way, will be described according to oneembodiment. Eq. (10) shows that noise in the laser distance measurementsm_(1L) and m_(2R) are related to the design parameters. Though therewill be noise in measurements m_(1R) and m_(2L), their influence on thelocalization results generally cannot be minimized by optimizing thedesign parameters. Hence, efforts are taken to reduce the influence ofnoise in measurement m_(1L) on the orientation results (δϕ′).

Since the location results can depend directly on the orientationresults, design optimization of the target is done for the orientationresults only. It can be presumed that the preferred orientation resultsare—localization error has a magnitude equal to or less than that ofnoise in measurements. The orientation formula in Eq. (10) can bere-written as follows:

$\begin{matrix}{{\sin \left( {\theta_{2R} - \varphi} \right)} = {\quad\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{1L}^{2} + m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack}} & (14) \\{{\sin \left( {\theta_{2R} - \left( {\varphi + {\delta \; \varphi^{\prime}}} \right)} \right)} = {\quad\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \begin{pmatrix}{\left( {m_{1L}^{2} + {\delta \; m}} \right)^{2} +} \\{m_{2R}^{2} - l^{2} - L^{2}}\end{pmatrix}^{2}}} - {{L\left( {m_{1L} + {\delta \; m}} \right)}\sin \; \theta_{1L}}}{{lm}_{2R}} \right\rbrack}} & (15)\end{matrix}$

Subtracting Eq. (15) form Eq. (14)

Left Hand Side:

$\begin{matrix}{\left. \Rightarrow{{\sin \left( {\theta_{2R} - \varphi} \right)} - {\sin \left( {\theta_{2R} - \left( {\varphi + {\delta \; \varphi^{\prime}}} \right)} \right)}} \right. = {{{\sin \left( {\theta_{2R} - \varphi} \right)} - {\sin \left( {\theta_{2R} - \varphi - {\delta \; \varphi^{\prime}}} \right)}} = {{{\sin \left( {\theta_{2R} - \varphi} \right)} - {{\sin \left( {\theta_{2R} - \varphi} \right)}\cos \; {\delta\varphi}^{\prime}} + {{\cos \left( {\theta_{2R} - \varphi} \right)}\sin \; {\delta\varphi}^{\prime}}} = {{{\sin \left( {\theta_{2R} - \varphi} \right)}\left( {1 - {\cos \; {\delta\varphi}^{\prime}}} \right)} + {{\cos \left( {\theta_{2R} - \varphi} \right)}\sin \; {\delta\varphi}^{\prime}}}}}} & (16)\end{matrix}$

If we can assume δϕ′ to be small, then under small angle approximationRHS of Eq. (16) can be rewritten as

=cos(θ_(2R)−ϕ)δϕ′  (17)

Subtracting Eq. (15) from Eq. (14)

Right Hand Side:

$\begin{matrix}{\quad{\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{1L}^{2} + m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack - {\quad{\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \begin{pmatrix}{\left( {m_{1L}^{2} + {\delta \; m}} \right)^{2} +} \\{m_{2R}^{2} - l^{2} - L^{2}}\end{pmatrix}^{2}}} - {{L\left( {m_{1L} + {\delta \; m}} \right)}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack =}}}} & (18) \\{\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{1L}^{2} + m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack - {\quad{\left\lbrack \frac{{{1/2}\sqrt{\begin{matrix}{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}} \\\left( {1 + \frac{\left( {m_{1L} + {\delta \; m}} \right)^{2}}{\left( {m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} \right)^{2}\end{matrix}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack =}}} & (19) \\{\left\lbrack \frac{{{1/2}\sqrt{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{1L}^{2} + m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack - {\quad\left\lbrack \frac{\begin{matrix}{{{1/2}\sqrt{\begin{matrix}{{4m_{1R}^{2}m_{2L}^{2}} - \left( {m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}} \\\left( {1 + \frac{\left( {m_{1L} + {2{\delta {mm}}_{1L}} + {\delta \; m^{2}}} \right)^{2}}{\left( {m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}} \right)^{2}\end{matrix}}} -} \\{L\left( {m_{1L} + {\delta m}} \right)\sin \; \theta_{1L}}\end{matrix}}{l\; m_{2R}} \right\rbrack}} & (20)\end{matrix}$

In Eq. (20) we can see that the term

$\frac{{2{\delta {mm}}_{1L}} + {\delta \; m^{2}}}{\left( {m_{2R}^{2} - l^{2} - L^{2}} \right)^{2}}$

is going to go to zero, because we are dividing a small value δm by adenominator which is the fourth power of measurements. When we equatethis term to zero, the terms inside the square root are exactly same andget cancelled. Thus the RHS becomes

$\begin{matrix}{\cong \left\lbrack \frac{{{L\left( {m_{1L} + {\delta \; m}} \right)}\sin \; \theta_{1L}} - {{Lm}_{1L}\sin \; \theta_{1L}}}{l\; m_{2R}} \right\rbrack} & (21) \\{\cong \left\lbrack \frac{L\; \delta \; m\; \sin \; \theta_{1L}}{l\; m_{2R}} \right\rbrack} & (22)\end{matrix}$

Equating Eq. (17) and Eq. (22) we get

$\begin{matrix}{{{\cos \left( {\theta_{2R} - \varphi} \right)}\delta \; \varphi^{\prime}} = {\left. \left\lbrack \frac{L\; \delta \; m\; \sin \; \theta_{1L}}{l\; m_{2R}} \right\rbrack\Rightarrow\frac{\delta \; \varphi^{\prime}}{\delta \; m} \right. = \left\lbrack \frac{L\; \sin \; \theta_{1L}}{l\; m_{2R}{\cos \left( {\theta_{2R} - \varphi} \right)}} \right\rbrack}} & (23)\end{matrix}$

In Eq. (23), left hand side is equal to or less than one if we want theerror in orientation results to be less in order than that of noise inmeasurement. This gives a limit on the design parameters which is givenin Eq. (24).

$\begin{matrix}{\frac{L}{l} \leq \left\lbrack \frac{m_{2R}{\cos \left( {\theta_{2R} - \varphi} \right)}}{\sin \; \theta_{1L}} \right\rbrack} & (24)\end{matrix}$

The right hand side of the above expression can vary between [0,m_(2Rmax)]. Here, m_(2Rmax) is the maximum value of m_(2R). Thoughmathematically, Eq. (24) has a lower bound of 0, realistically we cansay that

$\begin{matrix}{\frac{L}{l} \leq m_{2{Rmax}}} & (25)\end{matrix}$

The reasoning behind that is—If we have L=0, then the technique mightlose its robustness. When the laser sensor is made to stand at a singlepoint there is a chance that the target might not be detected. Hence Eq.(25) is the choice for an upper bound. Continuing, there is also a lowerlimit on the design parameters. In one embodiment, the design parametershave to be greater than twice the value of noise in the laser sensordistance measurements. This gives a lower bound on the design parametersgiven in Eq. (26). In Eq. (26) I_(max) denotes the maximum length of thetarget.

$\begin{matrix}{\frac{L}{l} \geq \frac{2\; \delta \; m}{l_{\max}}} & (26)\end{matrix}$

Simulation Results—Localization

In this section the simulations that were carried on according to oneembodiment to evaluate the vehicle orientation and localization formulaeare shown. In particular, a MATLAB based code was developed for the sameand the results are shown below. In this simulation, the noise ofmeasurements is approximated by a white Gaussian noise. FIG. 34 and FIG.35 show the accuracy of the kinematic based localization results whenthe vehicle is located in fourth and third quadrants respectively. Tofacilitate understanding by those skilled in the art, a black rectangleis drawn around the laser sensor guide way which shows the IWMR itself.

In FIG. 34, the left end of the laser sensor guide way is zoomed in toshow that the sensor location—left and the localization without noise inmeasurement matches perfectly. The localization with noise inmeasurement has small error, but it is of the order of 0.001 in both ‘x’and ‘y’ directions.

FIG. 36 and FIG. 37 show the accuracy of the localization algorithm whenthe orientation is different from 0 degrees.

In one example, sensor noise was considered to be 2% with m_(2Rmax)=2.For such a sensor, the optimal design parameters will be L=2*I. FIG. 38shows that, when L=4*I, the error in orientation result is 1 degrees.

FIG. 39 shows the error in results when the length of the target is 0.01units which is lesser than 2δm (0.04).

Simulation Results—Influence of Design Parameters

In this section the simulations that were carried on to evaluate thedesign parameter analysis are shown. FIG. 40 shows the error inorientation results vs. noise in measurements as a function of L/l. Atfirst sight it may seem like having a large target alone can reduce theinfluence of noise in measurement on the localization results. But theentire analysis in the preceding section showed that the ratio betweenthe design parameters is more important.

In this plot the target length ‘l’ is increased along with an increasein the laser sensor guide way length ‘L’ such that increase in L isgreater. Intuitively one might suggest that increase in target lengthhas to give better localization results. But FIG. 40 shows that thelocalization results get worse with an increase in the target length buta proportionally higher increase in laser sensor guide way length ‘L’.Moreover, the simulation results show that the localization accuracybecomes worse with increasing L/l ratio, which is consistent with theanalysis presented in the preceding section.

The assumption thus far in the entire work is that θ_(1L), θ_(1R),θ_(2L), θ_(2R) are known accurately. But the assumption cannot be alwaystrue due to limitations on the finite resolutions of angularmeasurements. The angular measurements have their own accuracy whichwill influence the orientation results as seen from the equations above.In order to have a rough estimate on how the results are going to beaffected by the angular measurement resolution error, the plot shown inFIG. 41 is generated by simulations. This can be helpful in choosingangular measurement devices depending upon the level of accuracydesired.

This disclosure presents an IWMR global localization technique usingonly an onboard laser sensor. Laser sensor is used to recognize thepattern of a unique target, which in turn is used as the reference tolocalize globally. A kinematic model for the global localization of IWMRusing laser sensor alone was developed and presented. Also, the targetdesign and the target recognition technique are presented. Hausdorffdistance based template comparison technique was used as the targetrecognition approach.

The experimental results show clearly that this technique can beimplemented merely placing the designed target in a known globallocation in an unknown environment. The experimental results show thaterror in localization results is lesser than the error in laser sensormeasurements which shows that this technique is robust to noise.

It will further be appreciated that several of the above-disclosed andother features and functions, or alternatives or varieties thereof, maybe desirably combined into many other different systems or applications.Also that various presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the present disclosure and/or the following claims.

NOMENCLATURE

-   l Length of the target-   d_(i) Depth of edge i in the target-   w_(i) Width of depth i in the target-   L Length of the laser sensor guide way-   θ_(1L) Angle made by the laser sensor from the left end on the guide    way to the left end of the target with positive x axis.-   θ_(1R) Angle made by the laser sensor from the left end on the guide    way to the right end of the target with positive x axis.-   θ_(2L) Angle made by the laser sensor from the right end on the    guide way to the left end of the target with positive x axis.-   θ_(2R) Angle made by the laser sensor from the right end on the    guide way to the right end of the target with positive x axis.-   Φ IWMR orientation with respect to the positive Xv axis used for    target recognition alone.-   m_(1L) Measurements denoted using the same convention as the angles    above.-   u_(s) Unit step function-   X_(v), Y_(v) IWMR body-fixed co-ordinates.-   ϕ IWMR orientation by localization.-   x_(v), y_(v) IWMR location in the body-fixed coordinates.-   x,y IWMR location in global co-ordinates.-   δm Noise in measurement of m_(1L).-   δϕ Error in orientation results due to noise in measurements.-   δϕ′ Error in orientation results due to δm alone.-   l_(max) Maximum length of the target.

1. A target system, comprising: a target that is selected, wherein thetarget includes a surface with depth variations; and a laser sensoradapted to scan the target for localization.
 2. The target system ofclaim 1, wherein the laser sensor is used to recognize a pattern of thetarget, wherein the pattern of the target is used as a reference for thelocalization.
 3. The target system of claim 1, wherein the target isselected based on a target design for the localization, wherein thetarget design includes a shape, surface, material, and color, whereinthe target is selected based on the target design that increases alikelihood of target detection capability and localization accuracy. 4.The target system of claim 1, wherein the depth variations of thesurface of the target include at least two edge depth variations.
 5. Thetarget system of claim 4, wherein each depth variation includes an edgedepth to width ratio, wherein the target is selected taking into accountthe edge depth to width ratio that is based on a worst angle of thelaser sensor.
 6. The target system of claim 5, wherein the worst angleof the laser sensor includes at least one of: an angle at which thelaser sensor loses a required accuracy to detect the target based onrefraction of a laser signal and an angle at which the entire length ofthe target cannot be detected by the laser sensor.
 7. The target systemof claim 5, wherein the target is selected based on a likelihood ofdetecting the target by the laser sensor, wherein the likelihood ofdetecting the target by the laser sensor is increased when the edgedepth to width ratio is greater than or equal to a tangent of the worstangle.
 8. The target system of claim 1, wherein the laser sensor isadapted to a laser scanner that is mounted on a rotary actuator, whereinthe rotary actuator provides the laser scanner with a capability ofrotary motion.
 9. The target system of claim 8, wherein the laserscanner and the rotary actuator are mounted to a linear actuator that isused as a guide way to move the laser scanner and the rotary actuatortogether along a lateral direction, wherein the linear actuator providesthe laser scanner with a capability of linear motion.